Be prepared that this indeed is not the end of it for them . That Elder will pow-wow with the other Elders and they will try again to get you to meet . Stick to your guns .
To stop incessant phone calls and questioning I had to send a certified letter to the Elders hinting at legal action if they did not cease /desist .I went to my local Police station and filed a copy of the letter with them also (stating this in the letter to the Elders makes an impact ) . It has been over a year since I sent that letter and so far no one has tried to contact me again .
Wishing you well